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Abstract 

Background: Proper malaria diagnosis depends on the detection of asexual forms of Plasmodium spp. in the blood. 
Thick blood smear microscopy is the accepted gold standard of malaria diagnosis and is widely implemented. 
Surprisingly, diagnostic performance of this method is not well investigated and many clinicians in African routine 
settings base treatment decisions independent of microscopy results. This leads to overtreatment and poor 
management of other febrile diseases. Implementation of quality control programmes is recommended, but 
requires sustained funding, external logistic support and constant training and supervision of the staff. This study 
describes an easily applicable method to assess the performance of thick blood smear microscopy by determining 
the limit of blank and limit of detection. These two values are representative of the diagnostic quality and allow the 
correct discrimination between positive and negative samples. 

Methods: Standard-conform methodology was applied and adapted to determine the limit of blank and the limit 
of detection of two thick blood smear microscopy methods (WHO and Lambarene method) in a research centre in 
Lambarene, Gabon. Duplicates of negative and low parasitaemia thick blood smears were read by several 
microscopists. The mean and standard deviation of the results were used to calculate the limit of blank and 
subsequently the limit of detection. 

Results: The limit of blank was 0 parasites/^iL for both methods. The limit of detection was 62 and 88 parasites/^iL 
for the Lambarene and WHO method, respectively. 

Conclusion: With a simple, back-of-the-envelope calculation, the performance of two malaria microscopy methods 
can be measured. These results are specific for each diagnostic unit and cannot be generalized but implementation 
of a system to control microscopy performance can improve confidence in parasitological results and thereby 
strengthen malaria control. 
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Background 

Despite a significant reduction in the number of cases since 
2000, malaria was still responsible for approximately one 
million deaths and 219 million cases in 2010, the majority 
in sub-Saharan Africa [1,2], Better diagnosis and treatment 
is a cornerstone for malaria control and future elimination 
campaigns. Inaccurate diagnosis is problematic for the 
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patient who receives either unnecessary or incorrect 
treatment with its risk of side effects and potential com- 
plications or prolonged disease episodes due to other 
underlying pathologies. In addition, patients may de- 
velop mistrust in the health care system when misdiag- 
nosis leads to wrong treatment decisions [3]. Moreover, 
inaccurate treatment can exert drug pressure on para- 
site populations and leads to development of resistance 
[4], Therefore, the World Health Organization (WHO) 
recommends that every case of malaria should be con- 
firmed before starting treatment [1]. Since the develop- 
ment of Giemsa stain in 1904 by Gustav Giemsa [5], 
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microscopy of Giemsa-stained thick blood smear (TBS) 
has been the gold standard for malaria diagnosis. In 
2010, an estimated 165 million of patients were tested 
by microscopic examination [6]. TBS is comparatively 
cheap (0.10-0.40 US$), can have excellent sensitivity and 
allows discrimination between plasmodial species as 
well as other blood-dwelling parasites, such as microfil- 
aria [3]. With minor modifications it can be used to 
quantify parasite density and haemozoin content for es- 
timation of whole body parasite burden [7-9]. However, 
TBS depends on well-maintained microscopes of good 
quality and experienced microscopists, conditions that 
are difficult to achieve in many endemic settings. Lack 
of confidence in diagnostic performance of TBS in en- 
demic areas is likely to be the source of the common 
clinical practice to treat with anti-malarials irrespective 
of parasitological results [10-12]. External quality as- 
sessment may improve the situation but is expensive, re- 
quires additional logistics and needs to be sustained to 
lead to improvement when baseline performance is poor 
[13]. An alternative strategy is implementation of in- 
ternal procedures to assess diagnostic performance that 
can be communicated to clinicians and external parties, 
provides training and self-assessment and is easy to im- 
plement. In this study standard laboratory methodology 
was applied to assess diagnostic performance of TBS 
microscopy in a representative African research centre 
and guidance for implementation is given. 

A particularly suitable measure of diagnostic perform- 
ance for TBS microscopy by a group of microscopist is 
the estimation of the limit of blank (LOB) and the limit of 
detection (LOD). LOB corresponds to the highest parasite 
count that is likely to be observed (with a pre-specified 
probability) for a blank sample meaning that if a sample 
has a parasitaemia below this value, it can be considered 
as negative with a stated probability. In contrast, LOD is 
the lowest parasite count in a sample which can be de- 
tected with a pre-specified probability, although perhaps 
not quantified as an exact value [14]. It means that a TBS 



with a parasitaemia above this value has a stated probabil- 
ity to be truly positive. These two values allow a reliable 
discrimination between negative and positive slides and 
are informative on the quality of readings. The LOB and 
LOD of TBS were evaluated using case-adapted "The 
Clinical and Laboratory Standards Institute" (CLSI/ 
NCCLS) guidelines [14] for the WHO and the Lambar- 
ene TBS method. The Lambarene method is a TBS 
modification that allows accurate parasite quantification 
because a defined volume of blood is spread over a de- 
fined area. It is routinely used in Lambarene and other 
centres throughout Africa and Europe [8]. Although 
there are several ways to calculate LOB and LOD, the 
CLSI guidelines have been chosen notably because they 
are specifically designed for methods reporting "zero" 
or positive only values. The method described here is 
easily applicable and allows measurement of diagnostic 
performance with very little extra logistics, effort and 
material. 

Methods 

Study site and volunteers 

The study was performed at the Centre de Recherches 
Medicales de Lambarene (CERMEL) in Gabon. It re- 
ceived approval by the regional ethics committee 
(CERIL) and followed the principles of the Declaration 
of Helsinki (6 th revision). Following informed consent, 
blood samples were obtained from five adult malaria pa- 
tients and five European volunteers recently arrived in 
Lambarene, who had no history of malaria. 

Preparation of thick blood smear 

For the WHO method, 10 uL of EDTA blood was distrib- 
uted on a circular area of a microscope slide (Figure 1). 
The slide was dried and stained for 20 minutes in a 20% 
Giemsa solution (Giemsa R-Solution, Merck, Darmstadt; 
Titrisol Puffer pH 7.2, Merck, Darmstadt). Four Giemsa 
preparations were used to have a better representation of 
laboratory routine. The slide was rinsed in tap water, dried 




Figure 1 Preparation of TBS. A) TBS prepared according to the WHO method and stained with Giemsa; B) Preparation of a TBS by the Lambarene 
method. 
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and 100 high power fields (HPF) were observed under a 
lOOx immersion oil objective (Nikon Eclipse E200, Tokyo, 
Japan or Olympus CH 30, Tokyo, Japan). The number of 
parasites (N Parasi tes) as well as the number of leucocytes 
(NLeucocytes) was counted and the parasitaemia was calcu- 
lated using the measured or assumed (8,000 cells/|iL) leu- 
cocytes count as reference: 

Parasites Np aras i tes -Leucocytes / ^L 



N 



Leucocytes 



For the Lambarene method, 10 \iL of blood was evenly 
distributed over an area of 10x18mm, dried and stained 
as for the WHO method. The contour of the 10x1 8mm 
rectangle was drawn on a piece of paper placed below 
the slide before spreading the sample (Figure 1). The 
number of parasites as well as the number of read HPFs 
was counted (at least 100) and parasitaemia per microlitre 
was calculated by a multiplication factor that depends on 
the magnification and the area of the microscopic field 
and represents the number of HPFs to be read for the 
examination of 1 \iL of blood and can either be derived 
from the optical specifications of the microscope or, as the 
preferred option, measured physically. 

The two microscopes used in Lambarene have a 
microscope factor of 560 and 800 and parasitaemia is 
calculated as follows: 



Parasites Np arasites 



Nhpf 



•Microscope Factor 



For each slide, an ID number was given as follows: 
LOD-X-Y-Z (LOD: name of the study, X: method used 
[W for WHO or L for Lambarene], Y: slide number and 
Z: number of the Giemsa coloration used [1 to 4]). To 
prepare the low parasitaemia slides, parasitaemia of each 
participant was determined and diluted with 0 + malaria 
negative blood to the required parasitaemia (10-100 par- 
asites/|iL). 

Randomization and blinding of the TBS 

To avoid bias, TBS were randomized and blinded. To 
create a random sequence, a third person, independent 
from the experiment sorted low-parasitaemia and nega- 
tive slides in random order. After this, each slide was 
given a new code on a non-transparent sticker hiding 
the ID number. The code consisted of the name of the 
study (LOD), the method used (L for Lambarene, W for 
WHO), the sequence number and the rank within the 
sequence (e.g. LOD_L_2_4). After one random sequence 
was read by all the microscopists, a new random se- 
quence was generated and blinded. As a consequence, 
each slide was read independently several times by all 
microscopists. 



Determination of the limit of blank (LOB) 

The LOB was estimated by reading replicates of negative 
slides and calculating the mean and the standard devi- 
ation from the results. It corresponds to a pre-defined 
percentile of the parasitaemia distribution of negative 
samples LoB = Pct B(<100 _ a) (Figure 2). Alpha (a) is the 
type I error and corresponds to the probability that a 
negative slide is read with a parasitaemia above the LOB 
and is consequently considered as positive. The Inter- 
national Organization for Standardization (ISO) recom- 
mends for the determination of LOB that a is set to 5%. 
Therefore, LOB corresponds to the 95 th percentile of the 
parasitaemia distribution of negative samples (Figure 2). 
In case of a Gaussian distribution of the results 



LOB = ft B + 1.645 a B 



(1) 



where \i B is the mean and a B the standard deviation of 
the parasitaemia of negative slides. 

In the case of a non-Gaussian distribution, the 95 th 
percentile is determined non-parametrically based on 
the ordered values [15]. The results are ranked in as- 
cending order and the LOB corresponds to the result at 
position N B • j§q + 0.5. 

Determination of the limit of detection (LOD) 

The LOD was obtained by repeated measurements of 
low parasitaemia TBS. If the distribution of the results is 
Gaussian then a defined percentage of the results will 
exceed the LOB but the rest will be below and, therefore, 




Observed Concentration 

Figure 2 Example for the distribution of a negative sample and 
one hypothetical low-level sample whose concentration is 
equal to the LOD. In that case 95% (100%-(3) of the measurements 
exceed the LOB. On the other hand, 95% of the measurements of the 
negative sample (100%-a) are below the LOB. Adapted from [14]. 
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be considered as negative (See Figure 2). This error is 
called type II error or |3. For this study p = a = 5% was 
allowed. The usual procedure to determine the LOD is 
to produce several low parasitaemia TBS (4 to 6) and to 
read them several times in order to create a series of 
measurements for each slide. For each series of measure- 
ments, the standard deviation o y is calculated. 



LOD = LOB + Cp-G poo i ed 



(2) 



Spooled is the pooled standard deviation of the measure- 
ments from each series and corresponds to an estimate 
of the total standard deviation. Cp is a bias-corrected es- 
timate of the 95 th percentile of the standard normal dis- 
tribution. Furthermore Cp and o poo i ed can be expressed 
by 



J pooled 



l{n-l)-Z« =1 ° 2 y 



f 



(3) 



where n-1 represents the degree of freedom per series 
with n the number of measurement per series (or slides), 
o y is the per series standard deviation and/= N s - K rep- 
resents the degree of freedom with Ns the total number 
of measurements and K the number of series (or slides) 
and 



(4) 



where z a is the a-quantile of the standard normal distri- 
bution. If data are not normally distributed but follow a 
Poisson distribution, they can be transformed by the 
square root transformation yielding the transformed 
values [16]. 



Yi 



(5) 



with Xi the read parasitaemia and Yi the square root 
transformed parasitaemia. The LOD is then calculated 
with the transformed values and then back transformed 
to the original unit. 

PCR 

The presence or absence of parasites in the samples as 
well as the Plasmodium species were confirmed by 
nested PCR as previously described [17]. 

Results 

Calculation of the LOB 

For the determination of LOB, 20 negatives slides were 
prepared from the malaria naive individuals. Five ran- 
dom sequences were prepared using 20 negatives slides 
and 20 positive slides. After blinding each sequence was 
read once leading to 100 measurements. For the deter- 
mination of the LOD, five random sequences of six low 



parasitaemia slides and two negative slides were pre- 
pared and read by six different microscopists. Therefore, 
60 additional measurements of the negative slides were 
produced and added to the previous results leading to a 
total of N B = 160 measurements. The results were not 
normally distributed. Therefore, the 95 th percentile was 
determined non-parametrically by the method of the or- 
dered values [15]. The results were ordered from the 
lowest to the highest parasitaemia (Table 1) and the 
LOB corresponding to the 95 th percentile was estimated 
as the result at the position Ns- j^q + 0.5=152.5 . For 
both methods, the results at position 152 and 153 are 0 
parasites/ (iL, hence the LOB of TBS microscopy was 0 
parasites/ (iL. 



Calculation of the LOD 

Several low parasitaemia TBS were prepared and six of 
them, representative of the different Giemsa stains and 
with a parasitaemia between 10 and 100 parasites/ \iL 
were selected, put in a random order together with two 
negative slides (see above) and blinded. After the first se- 
quence was read by all microscopists, the slides were 
randomized and blinded again in order to create a new 
sequence. A total of five such sequences were prepared 
and read by six microscopists. Thus, at the end each 
slide was read five times giving a total of N s = 6 slides x 
5 sequences x 6 microscopists = 180 measurements of 
the low parasitaemia slides. The data were not normally 
distributed, so they were transformed by the square root 
transformation [16]. The values Y t were obtained and 
used to calculate the pooled standard deviation accord- 
ing to formula (3) (see Table 2). For example for the 
Lambarene method: 

Table 1 Results of the negative slides for Lambarene and 
WHO methods 

Results (pf/ul) 



Rank 


Lambarene 


WHO 


160 


40 


70 


159 


18 


44 


158 


16 


0 


157 


10 


0 


156 


0 


0 


155 


0 


0 


154 


0 


0 


153 


0 


0 


152 


0 


0 


151 


0 


0 


150 


0 


0 



The results of the slides have been ordered from the lowest parasitaemia to 
the highest. Below the rank 150, the slides have been read as negative. The 
95 th percentile of the distribution is between position 152 and 153 (bold). 
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Spooled ' 



Spooled 



f 



(30-1) -(2.7S 2 + 3.52 2 + 1.57 2 + 2.59 1 + 2A5 2 + 2.19 2 



180-6 



2.58 



Because the transformed values Y t were used for the 
calculation, o poo ied nas to be back-transformed by for- 
mula (6) [18]. 



(6) 



Here X represents the mean of the measurements on 
the original scale. In the case of the Lambarene method, 
X= 54 parasites/uL. So finally, a x = 2-^/54.2.58 = 37.9. 
The LOD corresponds then to LOD = LOB + • o x . 

LODLamba = 0 + 1.647 • 37.9 = 62 parasites / fiL 

The LOD for the WHO method (LOD WHO ) was calcu- 
lated in the same way and gave 88 parasites/ uL. 



PCR results 

The negative samples were found negative by nested 
PCR. The low parasitaemia samples were positive for 



Plasmodium falciparum, but negative for Plasmodium 
vivax, Plasmodium malariae and Plasmodium ovale. 

Discussion 

Accurate diagnosis is an important tool in the fight 
against malaria and the universal access to a parasito- 
logical test is part of WHO objectives [1]. Microscopy of 
TBS remains the gold standard despite the emergence of 
new diagnostic methods such as Rapid Diagnostic Test 
(RDT) or PCR. Surprisingly, only little information is 
available on the diagnostic performance of this method. 
Two important characteristics describing the perform- 
ance of a laboratory method are the LOB and LOD. In 
the case of TBS, they depend on the quality of the sam- 
pling, the slide and the microscope, the number of ex- 
amined HPFs as well as the expertise of the reader [19]. 

Adapting guidelines edited by the CLSI/NCCLS [14], a 
LOB of 0 parasites/ uL was found, meaning that at least 
95% of the time, a negative slide was correctly identified 
as negative. This shows a very good specificity of TBS in 
this particular setting which is concordant with other 
studies showing 99% specificity under optimal condi- 
tions [20]. The LODs for the Lambarene and the WHO 
method were 62 parasites/ uL and 88 parasites/ uL re- 
spectively, showing that the Lambarene method is 
slightly more sensitive than the WHO method in the lo- 
cation where it was invented. The interpretation of this 



Table 2 Results of each series of measurement of low parasitaemia slides prepared according to Lambarene or WHO 
method before transformation (in parasites/uL) and after square root transformation 

Method: Slide ID 

Lambarene 



LOD-L-21 



LOD-L-16 



LOD-L-20 



LOD-L-17 



LOD-L-18 



LOD-L-12 



Non transformed 

Mean 

Median 

o 

Transformed 
Mean 
Median 
o 



105 

90 
60 

9.9 
9.5 
2.75 



77 
63 
59 

8.1 
7.9 
3.52 



63 
52 
27 

7.8 
7.2 
1.57 



45 
35 
34 

6.2 
5.9 
2.59 



26 
22 
20 

4.5 
4.7 
2.45 



0 
11 

1.9 
0 
2.19 



Method: WHO 

Non transformed 

Mean 

Median 

o 

Transformed 
Mean 
Median 
o 



Slide ID 



LOD-W-21 

116 
112 

35 

10.6 
10.6 
1.73 



LOD-W-18 

45 
47 
41 

5.3 
6.8 
4.11 



LOD-W-19 

102 
84 
56 

9.7 
9.2 
2.87 



LOD-W-20 

65 
66 
40 

7.5 
8.1 
2.94 



LOD-W-17-4 

35 
31 
36 

4.5 
5.5 
3.87 



LOD-W-17-1 

27 
15 
43 

3.5 
3.8 
3.83 



Each slide was read 5 times by 6 different microscopists. 
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finding is that a sample, with a parasitaemia above this 
limit, has a 95% probability to be correctly read as positive. 
However below this limit, the probability that the slide is 
mistaken as negative is higher than 5%. It is important to 
note that LOB/LOD studies are purely context dependent 
(e.g. in another setting the WHO method may result in 
better LOD) and shall be integrated in the routine labora- 
tory work to avoid potential confounders such as reading 
under "competition", which is likely to result in artificially 
low LODs. 

Although no similar work could be found in the litera- 
ture, the results are consistent with estimates of sensitivity 
in the field. Under optimal conditions sensitivity is ap- 
proximately four parasites/(iL but requires extended read- 
ing times: inspection of approximately 200 HPFs (the 
equivalent of approximately 0.5 \iL of blood) is required to 
detect two unambiguous parasites (diagnosis is usually not 
based on detection of a single parasite), hence one parasite 
per 100 HPFs corresponds to a parasitaemia of approxi- 
mately four parasites/ \xL [20,21]. In the field the sensitivity 
is estimated to be lower, commonly between 40-100 para- 
sites/|iL [22-24]. 

The most important discrimination of TBS is qualitative 
(negative versus positive) since it triggers anti-malarial 
chemotherapy. LOB and LOD estimates allow the reliable 
discrimination between positive and negative samples and 
consequently, they can help to improve patient care and 
to reduce the health care cost due to inadequate therapy, 
an issue that is particularly important in economically 
weak countries. A study from Kenya shows that micros- 
copy diagnostics can generate cost savings but the effect 
would be more important if clinical practice were revised 
and notably if results were respected [25]. Parasite density 
is associated with disease severity [26] and it is also im- 
portant in the setting of clinical trials with defined cut-offs 
for outcome definitions [27]. In endemic areas, distin- 
guishing malaria from other diseases even when parasites 
are present is not straightforward because of the non- 
specific symptoms of the disease [28] . Therefore, a reliable 
parasite cut-off must be determined and standardization 
between readers and study sites must be achieved. This 
method provides a tool for quality control, which is easy 
to implement and allows comparison between readers and 
diagnostic units. 

Conclusion 

Providing accurate and reliable data is of primary im- 
portance for every diagnostic laboratory therefore for 
most of the analytical methods and instruments, per- 
formance characteristics such as LOD and LOB are de- 
termined. This has not been done previously for TBS 
microscopy although this method has been used for 
more than one century. The LOB and LOD values deter- 
mined in this study are specific for the setting under 



study, however the method is easily applicable in any la- 
boratory performing TBS microscopy. It shall be used 
not only to provide information on the performance of a 
laboratory but also to improve clinicians' trust into la- 
boratory diagnosis of malaria. 

Abbreviations 

HPF: High power field; LOB: Limit of blank; LOD: Limit of Detection; 
o: Standard deviation; TBS: Thick blood smear. 
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